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f57> Abstract: A system and method for enhancing scanned document images utilizes an estimated background luminance (118) 
of a given digital image to remove or reduce (720) visual "see-through" noise. The estimated background lurmnanco .s dependent 
on the luminance values of the edges pixels of detected text edges of the image. In one embodiment, the e«ma ed background 
luminance is generated using only the edge pixels that are on the lighter side of the detected edges. In addmon to the see-through 
^movXmesystem and method may Uer enhance the scanned document images by removing (714) color fnnges and sharpemng 
and/or darkening (712) edges of text contained in the images. 
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SYSTEM AND METHOD FOR ENHANCING SCANNED DOCUMENT 
IMAGES FOR COLOR PRINTING 



5 FIELD OF THE INVENTION 

The invention relates generally to the field of image processing, and 
more particularly to a system and method for enhancing scanned 
document images. 

10 

BACKGROUND OF THE INVENTION 

Two-sided documents, i.e., documents having text and/or pictorial 
content on both sides of the paper, present challenges for producing 

is quality copies of the original documents. When two-sided documents are 
scanned in a copy machine or a scanner, visual noise may appear in the 
copies that was not present on the scanned surfaces of the original 
documents. The visual noise may be the result of digitally captured text 
and/or pictorial content printed on the opposite side of a scanned surface. 

20 Visual noise may also appear in copies when multiple documents are 
placed on a scanning device. In this situation, the visual noise may be the 
result of digitally captured text and/or pictorial content on a document that 
was adjacent to the scanned document. The appearance of visual noise 
caused by unwanted text and/or pictorial content will be referred to herein 

25 as the "see-through" effect. 

The see-through effect is more prevalent for copies of documents 
having a white or very light color background. In addition, the thickness of 
the scanned documents may increase the intensity of the visual noise, 
since thinner paper is more transparent than thicker paper. In general, 

30 documents typically contain black characters that are printed on thin white 
paper. Thus, the quality of document copies can be significantly 
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increased if the visual "see-through" noise can be effectively removed 
from the copies. 

In addition to the see-through problem, another copy quality issue 
arises when documents are reproduced using color scanners and color 
5 printers. This copy quality issue is the appearance of color fringes around 
the reproduced text. These color fringes are primarily due to scanning 
and printing errors. The scanning and printing errors cause the edges of 
the text in the copies to appear to be something other than black. The 
appearance of color fringes is a significant factor that degrades the overall 

10 quality of document copies. 

Conventional image enhancement approaches use variations of 
unsharp-masking to sharpen features in digitally captured document 
images. For example, according to one method, the sharpness is altered 
in the reproduction of an electronically encoded natural scene image by 
15 applying a filter function that increases maximum local contrast to a 

predetermined target value and increases all other contrast to an amount 
proportional thereto. According to another method, an adaptive spatial 
filter for digital image processing selectively performs spatial high pass 
filtering of an input digital signal to produce output pixel values having 
enhanced signal levels using a gain factor that effects a variable degree of 
enhancement of the input pixels. Thus, the pixels with activity values that 
are close to an iteratively adjustable activity threshold level will be 
emphasized significantly less than the pixels with associated activity 
values that are substantially above the threshold level. In still another 
method, a spatial-filter performs an adaptive edge-enhancement process 
that enhances the sharpness of edges, which are parts of an image 
having steep tone gradients. 

These conventional image enhancement approaches are effective 
for their intended purposes. However, these conventional methods do not 
address the problems of color fringe and see-through. In view of this 
deficiency, there is a need for a system and method to enhance scanned 
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document images by eliminating or reducing color fringes and visual "see- 
through" noise. 



5 SUMMARY OF THE INVENTION 

A system and method for enhancing scanned document images 
utilizes an estimated background luminance of a given digital image to 
remove or reduce visual "see-through" noise. In addition to the see- 

10 through removal, the system and method may further enhance the 
scanned document images by removing color fringes and sharpening 
and/or darkening edges of text contained in the images. These image 
enhancements allow the system and method to significantly increase the 
overall quality of the scanned document images. 

is In an exemplary embodiment, the system includes an edge 

detector, a background luminance estimator, and an image enhancer. 
These components may be implemented in any combination of hardware, 
firmware and software. In one embodiment, these components are 
embodied in the system as software that is executable by a processor of 

20 the system. 

The edge detector operates to detect edges of text contained in a 
given digital image containing visual noise. The background luminance 
estimator operates to generate a background threshold that is based on 
an estimation of the image background luminance. The background 

25 threshold is dependent on the luminance values of the edge pixels of the 
detected edges. In one embodiment, the background threshold is 
generated using only the edge pixels that are on the lighter side of the 
detected edges. The image enhancer operates to at least partially remove 
the visual noise by selectively modifying pixel values of the image using 

so the background threshold . The image enhancer may also perform color 
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fringe removal and text enhancements, such as edge sharpening and 
edge darkening. 

In an exemplary embodiment, the method in accordance with the 
invention includes the steps of receiving a digital image that contains 

5 visual noise, detecting edges of text contained in the digital image, and 
generating a background threshold based on an estimation of the image 
background luminance. The background threshold is dependent on the 
luminance values of the edge pixels of the text edges contained in the 
image. In one embodiment, the background threshold is generated using 

io only the edge pixels that are on the lighter side of the detected edges. 
The method further includes a step of modifying pixel values of the image 
using the background threshold to at least partially remove the visual 
noise from the image. The method may also include the step of 
selectively removing color data from the edges pixels to reduce color 

15 fringe or the step of enhancing the text contained in the image by 
sharpening or darkening the text edges. 

Other aspects and advantages of the present invention will become 
apparent from the following detailed description, taken in conjunction with 
the accompanying drawings, illustrated by way of example of the 

20 principles of the invention. 

BRIEF DESCRIPTION OF THE DRAWINGS 

Fig. 1 is an illustration of an image enhancing system in 
25 accordance with the present invention. 

Fig. 2 is an illustration of vertical differences for the luminance 
channel that are used to detect text edges in accordance with the 
invention. 

Fig. 3 is an illustration of horizontal differences for the luminance 
30 channel that are used to detect text edges in accordance with the 
invention. 
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Figs. 4 and 5 are process flow diagrams that illustrate the operation 
of a background luminance estimator of the image enhancing system in 
accordance with the invention. 

Fig. 6 shows an exemplary limiting function that may be used by 
5 the background luminance estimator. 

Fig. 7 is a process flow diagram of a method for enhancing 
scanned document images in accordance with the invention. 

10 DETAILED DESCRIPTION 

With reference to Fig. 1, an image enhancing system 102 in 
accordance with the present invention is shown. The image enhancing 
system operates to perform a number of image enhancements for 

15 scanned document images. These image enhancements include text 
edge sharpening, text edge darkening, color fringe removal, and "see- 
through" removal. Color fringe is the appearance of color around the text 
of a scanned document image that may be due to an image capturing 
error. See-through is the appearance of visual noise that was captured 

20 during the scanning process. The visual noise may be the result of 

digitally captured text and/or pictorial content printed on the opposite side 
of the scanned surface. Alternatively, the visual noise may be the result of 
digitally captured text and/or pictorial content on an adjacent document. 
The image enhancing system 102 includes an input interface 104, a 

25 volatile memory 106 and a non-volatile memory 108 that are connected to 
a processor 110. These components 104-110 are computer components 
that are readily found in a conventional personal computer. The image 
enhancing system further includes a color space converter 1 12, a low- 
pass filter 1 14, an edge detector 1 16, a background luminance estimator 

30 118, and an image enhancer 1 20, which are also connected to the 

processor 110. Although the components 112-120 are illustrated in Fig. 1 
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as separate components of the image enhancing system 102, two or more 
of these components may be integrated, decreasing the number of 
components included in the image enhancing system. The components 
1 12-120 may be implemented in any combination of hardware, firmware 
5 and software. Preferably, the components 1 12-1 20 are embodied in the 
image enhancing system 102 as a software program that performs the 
functions of the components 112-120 when executed by the processor 
110. 

The input interface 104 provides a means to receive digital images 

io from an external image capturing device, such as a scanner 122. The 
input interface may be a USB port, a serial port or any other interface port 
that is designed to interface the image capturing device to the image 
enhancing system 102. Alternatively, the input interface may be a network 
interface to receive digital images from a local network (not shown) or from 

15 the Internet (not shown). 

The color space converter 1 12 of the image enhancing system 102 
operates to convert a scan line of an input digital image between an 
original color space, such as an RGB color space, and a 
luminance/chrominance space, such as a YC r C b space. Although the 

20 YC r Cb space is preferred, other color spaces that include separate 

luminance components may be utilized. The color space conversion may 
be performed using a pre-calculated look-up table, which may be stored in 
the color space converter 1 12 or the non-volatile memory 108. 

The low-pass filter 1 14 of the image enhancing system 102 

25 operates to smooth each of the YC r C b components of the image scan line. 
The low-pass filter applies a Gaussian filtering to the luminance channel 
Y. The Gaussian filter/mask may be designed according to the following 
equation. 

mill = k • expL- fi\(i-cfHj-c?Vc 2 \; 0 <. i < M, 0 <, j < M, 
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where Mis an odd integer, c=(M-1)/2 is the center of the mask and k is a 
normalization factor such that ^GMM^.O. An example of such a 

/=0 j=0 

mask (with M=5 and j8=1 . 1 ) is shown below: 
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For the chrominance channels C r and C b , the iow-pass filter 1 14 applies 
an Mx ^averaging filter, which is the same size as the Gaussian filter 
applied to the luminance channel Y. The Mx M averaging filter may be 
seen as a special case of the Gaussian filter with /?=0. However, the 
averaging operation can be performed more efficiently than the Gaussian 
filtering. The reason why Gaussian smoothing is applied to the luminance 
channel Y instead of averaging is that the Gaussian smoothing is needed 
to preserve text edge locations of the digital image. 

The edge detector 1 16 of the image enhancing system 102 
operates to detect the preserved edges of text contained in the image 
15 scan line. From the Gaussian smoothed luminance data, the; edge 
detector calculates two metrics Dl and D2. The metric Dl is the sum of 
absolute values of adjacent differences. The metric Dl is used to 
determine whether a pixel of interest is a part of a text edge by comparing 
it to a threshold value T e . For a pixel of interest with index (3,3), the sum 
20 Dl of absolute values of adjacent luminance differences is defined by the 

following equation. 

\v n -v n \+\v 32 -v n \+\v n -V 32 \+\V 52 -V< 2 \ + 
\r* -v n \+\v 33 -v a \+\v K -v 33 \+\v S3 
\v u -v u \+\v u -v u \+\v„ -v M \+\v u -VJ+ 

\V n ~V 2 ^\V 23 -*y+l^4 - + 
W 32 -V 3l \+\V 33 - KJ + |F M -PJ+IF,, 

\v n -v n \+\v A3 -v n \ + \v u -v i3 \+\v„ -VJ, 
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where the variable V stands for Gaussian smoothed luminance Y . The 
D\ value is illustrated by Figs. 2 and 3. Fig. 2 shows the vertical 
differences, while Fig. 3 shows the horizontal differences. 

The metric D2 is a second-order derivative that is used to determine 
5 whether a text edge pixel is on the dark side or the bright side of the edge. 
The following second order derivative equation may be used to make the 
determination for a pixel of interest with index (3,3). 

D2 = V 13 + V a +V il +V 35 -4-V 3J 
If D1>0, the pixel is determined to be on the dark side of the edge. 
10 Otherwise, the pixel is determined to be on the bright side of the edge. 

In operation, the threshold value T e is initially set at a minimum 
value. In order to make the threshold value T e adaptive to some extent, 
the threshold value T e is allowed to float with the maximum value of the 
metric D\. The maximum value Dl mm is updated for every pixel, and for 
15 each image scan line, the threshold value T e is updated to T e =k Dl mm , if 
2' e <kvDl mait . Thus, the threshold value T e can only be increased. The 
minimum value of T e and the parameter k should be empirically 
determined by experiments. 

The background luminance estimator 118 of the image enhancing 
20 system 102 operates to compute an estimated background luminance Yjj 
for each image scan line, which is used by the image enhancer 120 for 
see-through removal. Initially, the estimated background luminance 7& is 
set to 255. The estimated background luminance Yb is then updated once 
per image scan line as described in detail below. The estimated 
25 background luminance Fft is computed using two histograms. The first 
histogram is a histogram of all pixel luminance values, and is denoted H y . 
The second histogram is a histogram of text edge pixels on the lighter side 
of edges, and is denoted H e . Both histograms are updated for each new 
pixel. 
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The operation of the background luminance estimator 118 to 
update the estimated background luminance 7& is described with 
reference to Figs. 4 and 5. At step 402, the histograms H e and H y are 
computed. Next, at step 404, copies of the histograms H e and H y are 
5 made. The original histograms H e and H y are used to update the 

histograms. The copies of the histograms H e and H y are used to compute 
the updated estimated background luminance 

For the histogram H e , steps 406, 408, 410, 412 and 414 are 
performed. At step 406, a determination is made whether the total edge 
io pixel count (pixels on the lighter side of detected edges) is greater than a 
given threshold C e . As an example, the threshold C e may be 100. If the 
total edge pixel count is greater than the threshold C e , the process 
proceeds to step 408, at which a windowed averaging is applied to smooth 
out small local noise. As an example, a window size of 7 may be used for 
is the averaging. However, if the total edge pixel count is not greater than 
the threshold C e , the process skips to step 410. At step 410, an 
object/background threshold x e is computed. The object/background 
threshold x e is a luminance value on the histogram H e that optimally 
separates the dominant values of object and background intensities. 
20 The object/background threshold t e may be computed using Kittler- 

lllingsworth algorithm, as described in J. Kittler and J. Illingworth, 
"Minimum Error Thresholding", Pattern Recognition, Vol. 19, No. 1, 41-47, 
1986, which is specifically incorporated herein by reference. For a 
grayscale image with pixel value g in the range of [0,»], a histogram h{g) 
25 that summarizes the gray level distribution of the image can be viewed as 
an estimate of the probability density function p(g) of the mixture 
population comprising gray levels of object and background pixels. 
Assuming that each of the two components (object and background) pigli) 
is a Gaussian distribution with mean m , standard deviation <r* and a priori 
30 probability P it the probability density function p[g) can be expressed by the 
following equation. 
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where 



p(g/0 = 



1 



exp - 



2crf 



2\ 



For a given p(g/i) and P it there exists a threshold x that satisfies the 
following conditions. 

Forg<T, P xP {gl\)>P 2 p(,gl2) 
Forg>r, P l p(gn)<P 2 p(g/2) 

However, the parameters //j, o\ and P\ are unknown. 

The Kittler-lllingsworth algorithm utilizes an arbitrary level Tto 

threshold the gray level data and model each of the resulting pixel 

populations by a normal density h{g\i,T) with parameters m(T), off) and 

Pff), which are defined by the following equations. 



P,(Z>5>(S). 



t i Kg)g 



b 



/p t (T) and 



y Zis = M l (T)} 2 Kg) 



15 where a = 



0, 



i=l 



and 6 = 



tr. 



i=l 
i = 2 



T+\, i = 2 

These definitions are used to express a criterion function J(T) which 
characterizes the average performance of replacing a gray level g by a 
correct binary value. The criterion function J(T) is defined by the following 
equation. 



•/(7>2>(g) 

g=0 



<r,(r) 



+2ioga,(r)-2io g p 1 (r) 



20 



+ ]£ Kg)- 



+ 21og<7 2 (7')-2iogi 2 (7') 
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Substituting the equations for W (7), a t (T) and P0) into the criterion 
function 7(7) yields the following equation. 

J(7')=l+2[P 1 (^)log<T 1 (^>+i , 2 (^ , )log^C7 , ) 

The optimal threshold x, or a minimum error threshold, is determined by 
finding a value that minimizes the above equation. 

After the object/background threshold x e is computed, a background 
peak eWhite on the histogram H e is determined, at step 412. The 
background peak eWhite corresponds to the peak in the upside range 
between the object/background threshold x e and 255 on the histogram H e . 
At step 414, a spread index S e is calculated. The spread index S e is 
defined as S e = (I m -7 to J/ 256, where I hig h and 7/ 0M ,are high and low 
luminance values of the spread that fall to half of the peak value. The 
Thigh value is located on the left side of the eWhite value, while the Ihigh 
value is located on the right side of the eWhite value. 

For the histogram 77^, steps 502, 504, 506 and 508 are performed. 
At step 502, a determination is made whether the total pixel count is 
greater than a given threshold C y . As an example, the threshold C y may 
be 10,000. If the total edge pixel count is greater than the threshold C y , 
the process proceeds to step 504, at which a windowed averaging is then 
applied to smooth out small local noise. As an example, a window size of 
7 may be used for the averaging. However, if the total pixel count is not 
greater than the threshold C y , the process skips to step 506. At step 506, 
an object/background threshold x y is computed. Similar to the 
object/background threshold x e , the object/background threshold x y is a 
25 luminance value on the histogram H y that optimally separates the 
dominant values of object and background intensities. At step 508, a 
background peak aWhite on the histogram H y is determined. The 
background peak aWhite corresponds to the peak in the upside range 
between the object/background threshold x y and 255 on the histogram H y . 
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25 



Although the steps 406-414 and 502-508 have been described in a 
sequential order, these steps do not have to be performed in the 
described order. The steps 406-414 and 502-508 may be performed such 
that steps 406-414 are interweaved with steps 502-508. Alternatively, 
some of the steps 502-508 may be performed simultaneously with steps 
406-414. 

Next, at step 510, a minimum acceptable value MIN_WHITE is 
established for the background peaks eWhite and aWhite by embedding 
MIN_WHITE in a non-linear function/ That is, eWhite'=jieWhite) and 
aWhite'=J{aWhUe). The simplest of such functions is a two segment linear 

function as defined below. 

f Vj ifv>MIN_WHJTE 
^ = { MOV _ WHITE, otherwise 
However, for images with mostly black figures and little unprinted regions, 
the background peaks eWhite and aWhite are usually far below the 
minimum acceptable value. In these cases, it may be desirable to reduce 
the effect of see-through removal that will be performed by the image 
enhancer 120 of the system 102, or even to not apply the see-through 
removal. This can be effectively realized by functions such as the 
following limiting function. 

v, if v> MINJVHFTE 

(255.0 -MINJWHITE) • exp(-(r • MIN_ WHITE/ 255 • v/255) 2 ) 
+ MIN_WHITE, otherwise 
A limiting function^) with MIN_WHITE=220 and r=3.5 is shown in Fig. 6. 
Other functions characterized by three distinct regions may also be used 
to achieve a similar effect. The three distinct regions are as follows: 1) a 
linear region from 255 down to MIN_WHITEfor effective see-through 
removal; 2) a flat holding-up region from MINJA/HITE down to a set value; 
and 3) a gradual blackout region. 
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Next, at step 512, weighted-averaging is applied to th background 
peaks eWhite and aWhite using the following formula to derive an initial 
background luminance white{n) for the current line n. 

white(n) = p ■ eWhite'+Q. - p) ■ aWhite', 

f 0.8 • (1 - S e ) + 0.2, if number of edge pixels in H e >C e 



At step 514, the estimated background luminance Yb is calculated 
using the following formula. 

y b (n + 1) = fi(n) ■ Y„ (») + (1 - /?(")) ■ white(n); 
7,(0 = 255; 

where « is the current line number, H is the height (in pixels) of the image 
10 and g is the adaptation boost. As an example, the parameters fi min , p max > 
and g may be set as follows: /? min = 0.9; fi^ = 0.995; and g = 10. The 
above formula introduces a spatial (scan line) dependent smoothing for 
see-through effect in the vertical direction. 

Turning back to Fig. 1 , the image enhancer 120 of the image 
is enhancing system 1 02 operates to enhance a given document image by 
performing text edge sharpening, text edge darkening, color fringe 
removal, and see-through removal. The enhancement operations that are 
performed by the image enhancer differ for edge and non-edge pixels of 
the image, as described in the following C-style pseudo-code. 




otherwise 



20 



i/Dl>T e { //edgepixel 

Y ou) = (k + 1) • Y - k • F; // unsharp - masking 
if D2>0 //pixel on dark side of edge 

Y 0 ut = (Your II darkening 
if dc r |+|c 6 b<2* c f ll 'low -chroma edge pixel, strip 



color 



C'=0; 
cr =0; 
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{ // keep the original color 

COUl _ r~T . 
r ~~ W» 

CJ"-C 4 ; 

y OUt Q OUt Q OUl _^ ftOUtQOUt gout . 

5 ; 

efee ^ // non-edge pixel 
YC r C b => RGB; 

//see-through removal / background control 
R~ =Q(R,Y„); 

io ; 

In the above pseudo-code, the parameter T c is a "colorful" threshold for 
determining the application of color fringe removal, and parameter * is a 
positive value for determining the strength of the edge sharpening. As an 
is example, T c = 15 and ft = 2.5 may be used. 

The function Q for see-through removal can take several forms. 
The simplest form is the following two-segment linear function. 

_|255 9 ifx>Y b 
Q( x > Y ^-]x.255/Y b , otherwise 

A more complex form is the following continuous non-linear function, 
20 which is commonly used for tone modification. 

'255, \fx> Y » 
Q(x,Y„) = 255 -[1.0-0.5 • (2(7, - x)IY b ) a f r , else if x>Y b /2 

255-[0.5-(2x/Y b ) a r, ° therwise 
In the above equation, the parameters a and y control the contrast and the 
gamma, respectively. In order to increase computational speed, the 
function Q{x,Y b ) can be implemented as a look-up table and updated for 
25 each scan line. After the enhancement operations, the enhanced image 
may be output to a printer 124 or a display 126, as shown in Fig. 1 . 
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Although the image enhancing system 102 has been described as a 
separate system, the system may 102 be a sub-system that is part of a 
larger system, such as a copying machine (not shown). 

A method of enhancing scanned document images in accordance 
5 with the invention is described with references to Fig. 7. At step 702, a 
scan line of a digital image is received. The digital image may be a 
scanned image of a document that contains text and/or pictorial content. 
At step 704, the image scan line is converted from the original color space 
to a luminance/chrominance space. As an example, the original color 
io space may be an RGB space, and the luminance/chrominance space may 
be a YC r C b space. At step 706, low-pass filtering is applied to 
luminance/chrominance channels. A Gaussian filter is applied to the 
luminance channel, while an averaging filter is applied to both 
chrominance channels, 
is Next, at step 708, text edges are detected by identifying edge 

pixels and then classifying the edge pixels on the basis of whether the 
pixels are on the dark side or the bright side of the edge. The edge 
detection involves calculating D\ and Ul values. The Dl value is used to 
identify the edge pixels using an adaptive threshold T e . The D2 value is 
20 used to classify the edge pixels. 

Next, at step 710, the background luminance is estimated to derive 
an estimated background luminance Y b . For edge pixels, steps 712, 714 
and 716 are performed. At step 712, text enhancement is performed on 
the edge pixels. The text enhancement includes edge sharpening and/or 
25 edge darkening. At step 714, color fringe removal is performed for the 
edge pixels. The edge pixels are then converted to the original color 
space, e.g., an RGB space, at step 716. For non-edge pixels, steps 718 
and 720 are performed. At step 718, the non-edge pixels are converted to 
the original color space. A see-through removal is then performed on the 
30 non-edge pixels, at step 720. 
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Next, at step 722, a determination is made whether the current 
image scan line is the last scan line of the image. If it is the last scan line, 
the method comes to an end. However, if the current image scan line is 
not the last scan line of the image, the method proceeds back to step 702 
5 to receive the next scan line of the image. The steps 702-722 are 
repeated until the last scan line of the image has been processed. 
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WHAT IS CLAIMED IS: 



1 . A method of enhancing digital images comprising: 

receiving (702) an input digital image containing visual noise; 
5 detecting (708) edges of a feature within said input digital 

image; 

generating (710) a background threshold based on an 
estimation of background luminance of said input digital image, said 
background threshold being dependent on luminance values of edge 

10 pixels of said edges; and 

selectively modifying (720) pixel values of said input digital 
image using said background threshold to at least partially remove said 
visual noise from said input digital image. 



15 
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30 



2. The method of claim 1 wherein said step of generating (71 0) said 
background threshold includes using only said edge pixels that are on a 
lighter side of said edges of said feature to generate said background 
threshold. 

3. The method of claim 1 or 2 wherein said step of generating (71 0) 
said background threshold includes locating (412, 508) a peak on a 
histogram of selected luminance values of said edge pixels that likely 
corresponds to said background luminance. 

4. The method of claim 3 wherein said step of locating (41 2, 508) said 
peak on said histogram includes computing (410, 506) a minimum error 
threshold of said histogram. 

5. The method of claim 3 or 4 wherein said step of generating (710) 
said background threshold includes calculating (414) the spread of a 
luminance distribution of said histogram defined by said peak. 
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6. A system for enhancing an input digital image containing visual 

noise comprising: 

an edge detector (116) for detecting edges of a feature 

within said input digital image; 

a background luminance estimator (118) for generating a 
background threshold based on an estimation of background luminance of 
said input digital image, said background threshold being dependent on 
luminance values of edge pixels of said edges; and 

an image enhancer (120) for selectively modifying pixel 
values of said input digital image using said background threshold to at 
least partially remove said visual noise from said input digital image. 

7. The system of claim 6 wherein said background luminance 
estimator (118) is configured to generate said background threshold using 
only said edge pixels that are on a lighter side of said edges of said 
feature. 

8. The system of claim 6 or 7 wherein said background luminance 
estimator (118) is configured to locate (412, 508) a peak on a histogram of 
selected luminance values of said edge pixels that likely corresponds to 
said background luminance. 



9. The system of claim 8 wherein said background luminance 
25 estimator (1 1 8) is configured to compute (410, 506) a minimum error 
threshold of said histogram to locate said peak on said histogram. 
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1 0. The system of claim 8 or 9 wherein said background luminance 
estimator (118) is further configured to calculate (414) the spread of a 
luminance distribution of said histogram defined by said peak. 
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FIG. 3 



WO 02/37832 



PCTYUS01/45426 



3/6 



Start 





t 


Compute Histograms E g and -n 


> 


f 



Make Copies of Histograms H g and 



N 




Edge Pixel Count >C e ? 




406 



Apply Windowed Averaging 



Compute Object/Background Threshold T f 



Determine Background Peak eWhite 



Calculate Spread S, of Background Peak eWhite 



FIG. 4 



1 r 

® 



02/37832 



4/6 



N 




Total Pixel Count > C y ? 




502 



Apply Windowed Averaging 



i 



Compute Object/Background Threshold T 



Determine Background Peak aWhite 



Establish Minimum Acceptable Value for eWMte and aWhite 



Apply Weighted-Averaging to eWkite and aWhite 



i 



Calculate Estimated Background Luminance Y b 



FIG. 5 




WO 02/37832 



5/6 



PCT/US01/45426 
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